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(57). [Abstract] 

[Object] To provide a method which, upon extracting a face 
area from a person's image, makes it possible to avoid an 
extraction error caused by a background portion, and also to 
efficiently extract the face area even in the case when a face 
image is greatly different from a retrieving use dictionary 
image and when the face image is given as an image other than 
the front face image, at low calculation costs. 
[Means to solve the problems] A retrieving area is 
preliminarily limited based upon differential image 
information between a person' s face area and a background image 
and upon generating block image data, the variable range of 
the block size is limited so that the calculation costs at 
the time of retrieving the face area are greatly reduced. 
Moreover, upon generating block image data in a collation area 
within the retrieving area, the longitudinal and lateral sizes 
of the block size are independently varied so that even in 
the case of a person' s face whose face parts, such as the eyes, 
nose and mouth, have positions greatly different from those 
of a face in dictionary image data, the differences are absorbed. 



Moreover, a several kinds of dictionary images created from 
a several kinds of face images in different directions are 
used so that extraction of the face image other than the front 
face is available. 

[0012] 

[Embodiments of the invention] Referring to Figures, the 
following description will discuss embodiments of the present 
invention. 

[0015] First, an explanation will be given of [1] a step for 
extracting a face area. Fig. 1 is an explanatory drawing that 
shows a method for extracting the face area, and Fig. 2 is 
a flow chart that shows the sequence of the processes. 
[0016] First, background image data is preliminarily picked 
up by using a preset monitor camera. Moreover, face images 
of the same person are picked up every 15 degrees, for example, 
within the range ± 30 degrees in the up and down directions 
as well as in the right and left directions based upon the 
front view, and concerning each of the images, the face area 
is divided into m face X n faC e blocks, and the average of the 
density values of eachblock is represented by a representative 
value. Then, these are stored in a face-area retrieving 
dictionary data base as dictionary image data for face areas. 
[0017] Next, an image of an ATM user is picked up by the monitor 



camera, and an image difference between this image and the 
background image preliminarily prepared is found. Then, a 
judgment is made as to the presence or absence of a difference 
based upon whether or not the image difference exceeds a 
threshold value for each of the pixels, and if there is a 
difference, a differential value 100 is put to the 
corresponding portion, and if there is no difference, a 
differential value 0 is put to the corresponding portion; thus, 
this is stored in the computer as binarized background 
differential image information. 

[0018] Next, a projection image is found by projecting the 
background differential image information to the respective 
x-axis (the axis of abscissa) andy-axis (the axis of ordinate) . 
Here, from the histogram curve of the projection image to the 
x-axis, two turning points and distance XL between the turning 
points are found, and from the histogram curve of the projection 
image to the y-axis, a rising point and a turning point first 
appearing on the histogram curve, and distance YL from the 
rising point to. the first appeared turning point of the 
histogram curve are found. Then, these two values XL, YL are 
set as an approximate size of the face area. Based upon the 
approximate size of the face area, the block size of a collation 
area is varied approximately XL/ m fa ce in the size in the x 
direction, and is also varied approximately YL/n f£ * ce in the 
size in the y direction. Moreover, based upon the approximate. 



size of the face area and the positions of the respective points , 
a retrieving area in the image is determined. For example, 
an area, which is constituted by the range between the two 
turning points in the histogram curve on the x-axis, and the 
range from the rising point to the first appeared turning point 
on the y-axis, is set as a retrieving area. This retrieving 
area is an area containing many pixels having the differential 
value 100 in the background differential image information. 

[0020] Successively, an explanation will be given of [2] a 
step in which a judgment (suspicious character judgment) is 
made as to whether or not one portion of the extracted face 
area. 

[0021] In the same manner as the preceding step, dictionary 
image data of the face area and dictionary image data of the 
eye area (divided into blocks of m ey ss X n ey es) and mouth area 
(divided .into blocks of m mouth X n mou th) are respectively 
prepared, and within the face area obtained in the preceding 
step, the area having the highest similarity to the dictionary 
image data of the eye area is obtained as an eye area, and 
the area having the highest similarity to the dictionary image 
of the mouth area is obtained as a mouth area. Then, in the 
case , when, at least, either of the eye area and mouth area 
goes lower than a preset threshold value, a judgment is made 
that the corresponding person has a suspicious character- 
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